Multiple POS Dependency-Aware Mixture of Experts for Frame Identification

نویسندگان

چکیده

Frame identification, which is finding the exact evoked frame for a target word in given sentence, fundamental and crucial prerequisite semantic parsing. It generally seen as classification task words, whose contextual representations are usually obtained using neural network like BERT an encoder, enriched with joint learning model or knowledge of FrameNet. However, distinction at fine-grained level, such delicate differences information syntax PropBank roles caused by different parts-of-speech (POS) neglected. We propose Multiple POS Dependency-aware Mixture Experts(MPDaMoE) that integrates five types information, consisting syntactic words nominal, adjectival, adverbial, prepositional, role only verbal. To better learn Experts employed, every expert Graph Convolutional Network, to incorporate dependency words. Our outperforms state-of-the-art models experiments on two benchmark datasets, shows its effectiveness.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Similarity Based Genre Identification for POS Tagging & Dependency Parsing Experts

POS tagging and dependency parsing achieve good results for homogeneous datasets. However, these tasks are much more difficult on heterogeneous datasets. In (Mukherjee et al., 2016, 2017), we address this issue by creating genre experts for both POS tagging and parsing. We use topic modeling to automatically separate training and test data into genres and to create annotation experts per genre ...

متن کامل

Creating POS Tagging and Dependency Parsing Experts via Topic Modeling

Part of speech (POS) taggers and dependency parsers tend to work well on homogeneous datasets but their performance suffers on datasets containing data from different genres. In our current work, we investigate how to create POS tagging and dependency parsing experts for heterogeneous data by employing topic modeling. We create topic models (using Latent Dirichlet Allocation) to determine genre...

متن کامل

LSTM-Based Mixture-of-Experts for Knowledge-Aware Dialogues

We introduce an LSTM-based method for dynamically integrating several wordprediction experts to obtain a conditional language model which can be good simultaneously at several subtasks. We illustrate this general approach with an application to dialogue where we integrate a neural chat model, good at conversational aspects, with a neural question-answering model, good at retrieving precise info...

متن کامل

A Bayesian Mixture Model for PoS Induction Using Multiple Features

In this paper we present a fully unsupervised syntactic class induction system formulated as a Bayesian multinomial mixture model, where each word type is constrained to belong to a single class. By using a mixture model rather than a sequence model (e.g., HMM), we are able to easily add multiple kinds of features, including those at both the type level (morphology features) and token level (co...

متن کامل

Mixture of Experts for Persian handwritten word recognition

This paper presents the results of Persian handwritten word recognition based on Mixture of Experts technique. In the basic form of ME the problem space is automatically divided into several subspaces for the experts, and the outputs of experts are combined by a gating network. In our proposed model, we used Mixture of Experts Multi Layered Perceptrons with Momentum term, in the classification ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3253128